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ABSTRACT 


This  paper  compares  the  classical  photogrammetric  approach  to  the  passive  ranging 
problem  with  the  approach  based  on  the  theory  of  optical  flow  applied  to  dynamic  imagery. 
It  also  describes  various  errors,  due  to  the  environment  and  imperfections  of  the  sensor 
system,  long  recognized  by  photogrammetrists  but  largely  ignored  by  proponents  of  the 
optical  flow  methodology. 

An  error  sensitivity  analysis  indicates  that  the  optical  flow  approach  is  more 
sensitive  to  errors— and  to  those  due  to  image  distortion,  in  particular— than  is  the 
photogrammetric  approach.  This  is  primarily  because  of  the  necessarily  small  line-of-sight 
angle  between  two  views  of  the  same  object  point  by  the  sensor,  especially  when  the 
sensor  platform  is  constrained  to  move  nearly  parallel  to  the  optical  axis  of  die  system. 

Although  this  constraint  on  the  platform  motion  guarantees  that  the  focus  of 
expansion  (FOE)  remains  in  the  field  of  view,  that  fact  does  not  make  the  system  less 
sensitive  to  error,  but  rather  more  so.  Analysis  shows  that  the  opposite  constraint  imposed 
by  photogrammetrists,  having  the  platform  move  in  a  direction  orthogonal  to  the  optical 
axis,  reduces  the  error  sensitivity  even  though  it  forces  die  FOE  out  of  the  field  of  view-in 
fact,  to  infinity. 
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I.  INTRODUCTION 


This  paper  analyzes  the  problem  of  estimating  the  range  of  a  remote  object  by 
means  of  image  data  that  a  passive  sensor  acquires  in  a  moving  airborne  platform.  The 
objective  is  to  characterize  the  nature  of  additional  information  needed  for  the  range 
calculation  and  to  examine  die  effect  of  optical  system  errors  on  its  accuracy. 

The  science  of  photogrammetry,  for  which  the  preferred  sensor  has  been  the  aerial 
photographic  camera,  has  dealt  with  similar  problems  for  more  than  a  century.  Although 
aimed  at  an  application  served  by  a  different  type  of  sensor,  the  present  analysis  is  entirely 
consistent  with  the  methods  of  classical  photogrammetry,  the  theory  and  practice  of  which 
Ref.  1  describes  in  considerable  detail. 

The  application  of  interest  here  is  real  time  passive  ranging,  for  which  the  forward- 
looking  infrared  (FUR)  device  is  a  more  appropriate  sensor  than  the  aerial  camera. 
Reference  2  proposes  a  computer-driven  system  to  solve  the  ranging  problem  by  means  of 
algorithms  that  exploit  dynamic  imagery  acquired  continuously  during  the  platform  motion, 
rather  than  the  static  data  recorded  on  film  by  traditional  photogrammetric  equipment 

The  approach  of  Ref.  2  is  one  developed  and  refined  in  recent  years  by  a  research 
community  interested  in  diverse  areas  of  science  and  modem  technology,  such  as  die  nature 
of  human  visual  perception  and  various  engineering  applications  involving  pattern 
recognition  and  automatic  scene  analysis. 

The  approach  has  two  operational  phases.  The  goal  of  the  first  phase  is  to  solve  a 
pattern  recognition  problem:  the  computer  must  select  some  number  of  points,  each  of 
which  has  identifiable  images  in  at  least  two  different  frames  of  the  changing  scene.  With 
the  aid  of  this  data  and  certain  other  information,  the  goal  of  the  second  phase  is  to  derive 
for  a  particular  point  a  range  estimate  relative  to  the  instantaneous  sensor  position 
associated  with  one  of  the  frames. 

The  second-phase  calculation  relies  on  certain  geometrical  information  that  the 
methodology  can  infer  from  the  way  the  image  data  changes  as  the  platform  and  sensor 
move.  Investigators  call  the  continuous  image  change  "optical  flow,"  the  properties  of 
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which  are  quite  simple  when  the  sensor  motion  is  strictly  translational.  In  fact,  optical  flow 
in  the  absence  of  rotation  behaves  according  to  the  rules  of  perspective  (cf.  Ref.  3)  known 
to  artists  for  hundreds  of  years. 

Obviously,  both  phases  of  the  passive  ranging  operation  contribute  errors  to  the 
range  estimate.  However,  proponents  of  the  dynamic  imagery  methodology  (cf.  Ref.  2), 
when  concerned  about  errors  at  all,  have  concentrated  on  those  arising  in  the  first  phase, 
ignoring  for  the  most  part  those  associated  with  the  second. 

Fortunately,  classical  photogrammetrists,  not  having  to  contend  with  the  first 
phase,  have  paid  considerably  more  attention  to  errors  ascribed  to  equipment  and  the 
environment  that  affect  the  second  phase.  Reference  1  deals  at  length  with  this  subject 

A  primary  objective  of  this  paper  is  to  relate  the  fund  of  knowledge  built  up  over  the 
years  by  photogrammetric  experience  to  the  problems  still  to  be  faced  in  applications  of  the 
dynamic  imagery  methodology.  As  a  preliminary  step  toward  this  goal,  Section  II  reviews 
some  relevant  topics  in  basic  optical  theory  and  photogrammetry. 

Section  HI  presents  an  independent  analysis  of  the  optical  flow  phenomenon  in  the 
context  of  classical  geometrical  optics,  obtaining  results  equivalent  to  some  given  in  the 
literature  concerned  with  dynamic  imagery  methodology.  It  also  discusses  implications  of 
the  results  for  applications  such  as  passive  ranging  and  compares  them  with  similar 
implications  that  have  influenced  the  standard  methods  of  photogrammetry. 

Section  IV  lists  the  error  sources  discussed  in  Ref.  1,  which  also  describes 
instrument  calibration  techniques  for  correcting  them.  Section  V  analyzes  the  propagation 
of  image  parameter  errors  due  in  part  to  such  sources  and  discusses  their  influence  on  the 
accuracy  of  range  estimates  obtained  by  means  of  optical  flow  methods.  The  error 
propagation  analysis  of  Section  V  results  in  Eqs.  (22)  and  (23),  which  give  the  fractional 
error  in  the  range  estimate  explicitly  in  terms  of  all  image  parameter  errors,  including  those 
derived  from  the  effects  noted  in  Section  IV. 

Section  VI,  using  results  from  Section  V,  derives  the  effect  of  optical  distortion  on 
the  error  in  estimating  the  range  of  an  object  point  on  the  ground  observed  at  two  different 
instants  by  a  sensor  moving  at  constant  velocity  parallel  to  the  ground.  For  the  case  treated 
in  Section  VI,  it  is  assumed  that  the  optical  axis  of  the  sensor,  the  velocity  vector,  and  the 
vertical  are  coplan ar  and  that  the  object  point  also  lies  in  the  same  plane.  Appendix  B 
generalizes  this  treatment  to  include  the  case  in  which  the  object  point  does  not  lie  in  the 
plane  determined  by  the  optical  axis  and  the  velocity  vector. 
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Section  VII  briefly  summarizes  some  earlier  conclusions,  including  the  minimum 
data  requirements  for  passive  ranging  and  the  limitations  of  image  analysis  for  that 
purpose.  It  also  recalls  some  observations  made  in  this  document  about  error  sensitivity 
and  some  conclusions  about  what  steps  are  necessary  in  acquiring  image  data  for  accurate 
range  estimation. 

Appendix  A  derives  a  method  for  calculating  the  instantaneous  translation  and 
rotation  of  the  sensor  in  terms  of  optical  flow  data.  Unlike  others  found  in  the  literature, 
this  method,  which  appears  to  be  new,  has  die  advantage  of  providing  the  results  in  closed 
form. 
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H.  CLASSICAL  OPTICS  AND  PHOTOGRAMMETRY 


Passive  ranging  is  the  operation  of  estimating  the  distance  between  an  object  in 
space  and  a  local  reference  point  relative  to  a  passive  imaging  sensor  that  supplies  the 
requisite  data.  The  algorithms  used  for  the  calculation  must  be  consistent  with  geometrical 
optics,  which  provides  the  classical  mathematical  model  for  an  optical  instrument  or 
imaging  system. 

According  to  that  theory,  the  ideal  imaging  system  generates  a  one-to-one  mapping 
of  the  points  in  a  three-dimensional  object  space  to  the  points  in  a  three-dimensional  image 
space  by  means  of  rays  that  obey  the  laws  of  refraction  and  reflection.  Ideally,  each  object 
point  defines  a  pencil  of  rays  which,  when  traced  through  the  system,  eventually  converge 
to  form  another  pencil  centered  at  the  corresponding  image  point 

Geometrical  optics,  which  determines  the  rays  connecting  object  points  with  image 
points,  predicts  that,  except  for  certain  image  points  called  stigmatic  images,  not  all  of  the 
rays  in  a  ray  bundle  will  intersect  a  single  point  Thus,  in  general,  the  ray  bundles 
associated  with  image  points  are  only  approximately  pencils.  However,  for  well-corrected 
optical  instruments  and  for  image  points  on  a  particular  surface,  ideally  a  plane,  the 
deviation  of  the  actual  ray  bundles  from  ideal  pencils  in  image  space  is  physically 
negligible. 

In  fact,  the  first-order  paraxial  approximation,  the  limit  in  which  die  angle  that  every 
ray  makes  with  the  optical  axis  approaches  zero,  also  known  as  Gaussian  optics,  depicts 
the  performance  of  a  well-designed  imaging  sensor  accurately  enough  for  most  purposes. 
Nevertheless,  certain  errors  that  do  occur  are  important  in  the  passive  ranging  application. 
If  not  corrected  in  the  range  calculations,  these  errors,  to  be  discussed  later,  should  be 
taken  into  account  in  assessing  the  limitations  of  the  process. 

It  is  assumed  that  the  optical  system  is  cylindrical^  symmetric  about  an  optical  axis 
and  that  the  propagation  medium  in  the  image  space  is  the  same  as  that  in  the  object  space. 
Then,  according  to  Gaussian  optics,  the  instrument  is  equivalent  to  the  geometrical 
construct  illustrated  in  Fig.  1. 
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PRINCIPAL  PLANES 


OBJECT  POINT 


Figure  1.  Optical  Coordinate  Systems. 


The  front  and  back  principal  planes  associated  with  the  instrument  are  perpendicular 
to  the  optical  axis  Z  and  intersect  it  at  the  front  and  back  nodal  points  P  and  P'.  The  front 
and  back  focal  planes  are  also  perpendicular  to  Z  and  intersect  it  at  O  and  O'.  Because  of 
the  stated  assumptions,  the  system  has  a  single  focal  length  f  equal  to  die  distance  between 
O  and  P,  which  in  turn  is  equal  to  the  distance  between  O'  and  F. 

It  is  customary  to  use  separate  (right-handed)  Cartesian  coordinate  systems  to 
define  points  in  die  image  and  object  spaces.  The  object-space  Z  axis  and  the  image-space 
Z’  axis  are  both  coincident  with  the  optical  axis.  The  object-space  X- Y  plane  is  the  front 
focal  plane  at  O,  and  the  image-space  X’-Y1  plane  is  the  back  focal  plane  at  O'.  The  X' 
axis  is  parallel  to  the  X  axis,  and  the  Y  axis  is  parallel  to  the  Y  axis. 

According  to  Newton's  lens  law,  if  Z  is  the  Z  coordinate  of  an  object  point  and  Z’ 
is  the  Z*  coordinate  of  the  corresponding  image  point,  then  one  has 

ZZ'  =  -  f2  ,  (1) 

which  defines  the  conjugate  planes  where  corresponding  object  and  image  points  lie.  Also, 
according  to  the  first-order  optical  theory,  the  principal  ray  connecting  an  object  point  with 
P  maps  into  a  parallel  ray  connecting  P'  with  the  corresponding  image  point  in  image 
space. 

If  the  object  point  moves  to  infinity,  its  position  is  defined  by  the  direction  of  a 
corresponding  principal  ray  through  P.  The  conjugate  image  plane  becomes  the  back  focal 
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plane,  and  the  principal  ray,  which  maps  into  a  parallel  ray  through  P'  in  image  space, 
determines  the  image  point  in  the  focal  plane. 

The  projective  transformation  of  every  object  point  into  an  image  point  on  a 
conjugate  image  plane  by  a  sensor's  optical  system  provides  the  data  that  is  the  basis  for 
classical  photogrammetry.  From  the  image-plane  coordinates  of  the  same  image  point 
viewed  by  two  sensors  in  different  locations,  it  is  theoretically  possible  to  determine  the 
object  point's  object-space  coordinates  relative  to  either  sensor  if  the  transformation  from 
the  coordinate  systems  associated  with  one  sensor  to  those  associated  with  the  other  is 
known.  Photogrammetrists  refer  to  two  such  images  of  the  same  point  as  a  stereoscopic 
pair. 

In  fact,  if  several  points  occur  simultaneously  in  a  stereoscopic  pair  of  scenes,  it  is 
also  theoretically  possible  to  reconstruct  the  required  coordinate  transformation  from  the 
combined  image  data  and  some  additional  information.  This  additional  information  usually 
includes  the  distances  between  certain  object-space  control  points. 

The  basis  for  locating  an  object  point  by  means  of  two  images  is  geometrically 
simple.  The  process  can  be  described  in  terms  of  die  first-order  optics  model  of  an  imaging 
sensor  as  follows. 

When  the  sensor  is  focused  on  a  region  of  points  in  object  space,  the  front  nodal 
point  P  is  the  center  for  the  projection  of  the  object  points  onto  the  conjugate  image  plane, 
the  distance  of  which  from  the  back  principal  plane  is  presumed  known.  It  is  customary  to 
replace  the  true  image  plane  conceptually  by  an  equivalent  one  that  is  the  same  distance  on 
the  other  side  of  the  front  principal  plane.  Then  the  image  of  any  object  point  occurs  where 
the  ray  connecting  the  front  nodal  point  to  the  object  point  intersects  the  equivalent  image 
plane. 

If  the  same  object  point  is  viewed  from  two  different  sensor  positions,  the  two 
projection  rays  that  determine  the  corresponding  image  points  associated  with  the  sensor 
positions  must  both  intersect  that  object  point.  Since  each  ray  is  determined  by  a  single 
point  image  relative  to  one  sensor  coordinate  system  and  the  rays  can  intersect  in  only  one 
point,  the  two  images  must  determine  the  location  of  the  object  point  uniquely.  Figure  2 
illustrates  the  geometrical  configuration  underlying  this  argument 

The  most  general  rigid-body  coordinate  transformation  from  one  sensor  position  to 
the  other  consists  of  a  translation,  defined  by  three  parameters,  and  a  rotation,  given  by  an 
orthogonal  matrix,  which  is  also  defined  by  three  parameters.  Thus,  the  transformation 
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from  the  coordinate  system  associated  with  one  sensor  to  that  associated  with  the  other  is 
specified  by  six  parameters. 


OBJECT 


X’f  POINT 


Figure  2.  Locating  an  Object  Point  by  Means  of  Two  Image  Points. 


A  standard  photogramme  trie  procedure  for  determining  the  transformation  between 
the  coordinate  systems  associated  with  a  stereoscopic  pair  depends  on  the  ray  projections 
used  to  locate  an  object  point  and  is  based  on  a  general  relation,  called  the  coplanarity 
equation  (cf.  Ref.  1,  p.  55  ff.),  implied  by  the  geometric  constraints  inherent  in  the 
projections.  The  equation  is  an  analytical  statement  of  the  fact  that  the  three  lines 
connecting  the  object  point  and  the  front  nodal  points  that  are  the  centers  of  projection  for 
the  two  sensors  form  a  triangle  and  must  therefore  lie  in  the  same  plane.  Every  pair  of  rays 
corresponding  to  a  pair  of  images  of  some  object  point  viewed  at  both  sensor  positions 
determines  a  coplanarity  equation  in  this  way. 

That  is,  if  Ri  is  the  coordinate  vector  from  the  nodal  point  to  the  object  point  when 
the  system  is  in  position  1,  R2  is  the  corresponding  object  point  coordinate  vector  when  the 
optical  system  is  in  position  2,  and  T  is  the  translation  vector  from  the  position  1  nodal 
point  to  the  position  2  nodal  point,  then  the  coplanarity  condition  is 

T  •  Ri  x  R2  =  0. 
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The  equations  derived  from  coplanarity  are  nonlinear,  and  all  are  homogeneous  in  at 
least  one  unknown.  Thus,  in  principle,  five  or  more  such  ray  pairs  should  suffice  to 
determine  five  of  the  six  parameters  that  characterize  the  coordinate  transformation,  i.e.,  up 
to  a  scale  factor.  The  photogrammetric  practice  is  to  use  the  coplanarity  relation  to 
construct  a  two-dimensional  image  map  of  an  object-space  region  but  to  use  other 
procedures  to  derive  the  map  scale. 

Another  geometrical  fact,  that  the  nodal,  image,  and  object  points  on  a  ray  must  be 
collinear,  leads  to  the  relation  called  the  collinearity  equation  (cf.  Ref.  1,  p.  88  ff.),  which 
is  used  as  an  alternative  to  the  coplanarity  equation  for  some  purposes.  In  particular,  e.g., 
in  the  Church  method  of  space  resection  (Ref.  1,  p.  60  ff.),  it  is  customary  to  determine  the 
scale  of  a  map  by  means  of  the  collinearity  relation  applied  to  three  known  object-space 
control  points. 

Equation  (6)  in  Section  in  can  be  regarded  as  equivalent  to  the  collinearity  condition 
in  the  limit  of  a  small  difference  between  the  two  coordinate  systems  associated  with  a 
stereoscopic  pair.  However,  some  of  the  quantities  in  the  corresponding  system  of 
equations  in  Ref.  1  are  expressed  in  object-space  coordinates  rather  than  the  image-space 
coordinates  used  in  Eq.  (6). 

Reference  1  describes  several  numerically  efficient  methods  for  solving  the 
nonlinear  systems  of  equations  resulting  from  the  coplanarity  and  collinearity  conditions,  as 
well  as  statistical  methods  for  dealing  with  random  errors  and  noisy  data.  It  is 
geometrically  evident  that  the  estimated  object-point  position  given  by  a  pair  of  rays 
projected  from  the  corresponding  image  points  at  two  different  sensor  positions  is  less 
sensitive  to  error  if  the  angle  between  the  rays  intersecting  at  the  object  point  is  wide  rather 
than  narrow.  This  is  more  likely  to  be  the  case  if  the  angular  coordinates  of  the  two 
corresponding  image  points  relative  to  the  projection  center  and  optical  axis  at  each  sensor 
position  are  markedly  different  rather  than  nearly  the  same. 
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in.  OPTICAL  FLOW  METHODS 


From  a  point  of  view  somewhat  different  from  that  of  classical  photogrammetry, 
this  section  addresses  the  problem  of  determining  the  coordinate  transformation  between 
the  two  image  frames  of  a  stereoscopic  pair.  The  purpose,  however,  is  still  the  same:  to 
derive  sufficient  relations  between  the  image  data  and  the  parameters  defining  the 
coordinate  transformation  to  make  it  possible  to  deduce  the  transformation  from  the  image 
data.  Consistent  with  die  photogrammetric  experience  cited  in  Section  II,  it  will  be  found 
that  only  five  of  the  parameters  necessary  to  characterize  the  rotation  and  translation  of  the 
coordinate  system  can  be  obtained  in  this  way.  The  magnitude  of  the  translation  vector  will 
then  remain  to  be  determined  by  other  means. 

In  recent  years,  an  interest  in  the  optical  theory  of  nontraditional  disciplines  such  as 
image  analysis  and  pattern  recognition,  with  such  nontraditional  applications  as  the 
modeling  of  human  or  animal  vision  and  robotics,  has  fostered  another  approach  to  goals 
that  are  similar  to  if  not  identical  with  those  of  photogrammetry.  The  basis  for  this 
approach  is  a  phenomenon  called  optical  flow,  which  refers  to  the  apparent  motion  of 
points  in  die  image  plane  of  a  sensor  that  is  moving  relative  to  object  space. 

In  particular,  if  the  sensor  motion  consists  entirely  of  a  linear  rigid-body  translation, 
the  image  points  appear  to  flow  away  from  or  toward  a  single  point  called  the  focus  of 
expansion  (FOE),  which  remains  stationary.  The  FOE  is  clearly  the  point  where  an 
extension  of  the  sensor  velocity  vector  at  the  nodal  point  would  intersect  the  image  plane. 

When  the  sensor  also  undergoes  a  change  of  attitude  due  to  a  rotation  about  some 
axis,  the  resulting  optical  flow  in  general  will  obscure  the  true  FOE  associated  with  the 
translational  motion  alone.  For  the  purpose  of  deriving  the  correct  FOE,  methods  for 
extracting  the  optical  data  supplied  by  the  translational  component  of  the  motion  have 
appeared  in  a  number  of  papers  in  the  last  decade. 

As  just  observed,  a  knowledge  of  the  FOE  is  equivalent  to  a  knowledge  of  the 
translation  direction,  i.e.,  it  supplies  only  two  of  the  six  parameters  needed  to  locate  the 
position  of  an  object  point  by  means  of  data  derived  from  two  different  scenes  that  contain 


its  image.  When  this  is  the  objective,  proponents  of  optical  flow  methodology  must 
supplement  the  calculation  with  additional  information  at  their  disposal  or  derived  from 
other  geometrical  properties  of  the  viewed  images. 

It  is  obvious  that  the  optical  flow  approach  is  valid  in  principle.  Any  pair  of  image- 
plane  displays  obtained  at  two  different  instants  while  a  sensor  moves  will  satisfy  the  basic 
photogrammetric  requirement  for  two  different  views  of  the  same  object  point  Therefore, 
as  observed  earlier,  if  five  or  more  recognizable  points  occur  in  both  scenes,  the  standard 
methods  of  analytical  photogrammetry  will  yield  most  but  not  all  of  the  data  needed  to 
determine  completely  the  most  general  rigid-body  motion  of  an  imaging  system.  In  fact 
the  image  data  supplied  by  a  sensor  in  continuous  motion  over  time  is  similar  to  data 
derived  from  a  sequence  of  static  photographs  and  used  in  the  aero  triangulation  process  (cf. 
Ref.  1,  Chapter  DC)  for  accurately  scaled  terrain  mapping  by  means  of  aerial  photography. 

Deriving  the  relationship  between  optical  flow  and  the  rigid-body  motion  of  an 
imaging  system  is  a  straightforward  matter.  For  this  purpose  it  is  convenient  to  use  a 
coordinate  sysem  for  which  the  X-Y  plane  is  coincident  with  the  front  principal  plane 
instead  of  the  object-space  coordinate  system  described  earlier  and  shown  in  Fig.  1.  It  is 
also  convenient  to  represent  geometric  position  and  motion  in  terms  of  vectors:  with  the 
Cartesian  coordinates  (x,  y,  z)  of  a  point  given  by  the  components  of  a  radius  vector 
xi  +  yj  +  zk,  where  i,  j,  and  k  are  unit  vectors  along  the  X,  Y,  and  Z  coordinate  axes. 

The  front  nodal  point,  which  is  also  the  origin  of  the  coordinate  system,  will  be 
regarded  here  as  the  center  of  die  optical  system's  motion.  The  instantaneous  velocity  ft  of 
any  point  that  is  fixed  in  space  is  given  by 

ft=*-v  +  Rxa>,  (2) 

where  v  is  the  translational  velocity  of  the  origin  and  to  is  the  rotational  velocity  of  the 
coordinate  system  about  some  axis  through  the  origin. 

To  avoid  confusion  between  the  image-plane  distance  and  the  focal  length,  as 
indicated  in  Fig.  2,  the  distance  of  the  (equivalent)  image  plane  from  the  origin  will  be 
designated  by  D  here,  although  it  has  become  customary  to  use  f  for  this  purpose.  This 
precaution  is  mainly  cosmetic,  since  for  most  cases  of  interest  replacing  D  by  the  focal 
length,  for  which  f  is  also  the  usual  symbol,  would  create  a  negligible  error  in  a  range 
estimate. 


Lower  case  letters  will  be  used  to  designate  image-point  radius  vectors.  That  is,  a 
vector  r  with  components  (u,v)  in  the  image  plane  is  understood  to  be  the  vector  with 
components  (u,v,d). 


From  the  projective  construction  of  the  image  point  corresponding  to  an  object 
point,  it  is  geometrically  evident  that  the  image  of  an  object  point  given  by  the  vector 


R  =  Xi  +  Yj  +  Zk 

(3) 

is  given  by  the  vector 

r«DR/Z. 

(4) 

From  (4)  it  follows  that 

r  »  D(ZR  -  ZRj/Z2  =  -  Dk  x  (R  x  R)/Z2  . 

(5) 

On  substituting  from  (5)  into  (2)  and  applying  standard  vector  identities,  it  follows 
that 

r  «  D[-  Zv  +  vz  R  -  (R  •  ©)(k  x  R)  +  R2  (k  x  ©jj/Z2  . 

After  substituting  from  (4),  this  becomes 

r»-Dv/Z-vzr/Z+(r-©)(kxr)/D  +  r2(kx  ©)/D  .  (6) 

The  vector  differential  equation  (6)  defines  the  optical  flow  of  all  image  points  at  an 
instant  of  time  in  terms  of  the  instantaneous  translation  and  rotation  velocities  of  the  sensor. 
It  is  equivalent  to  a  pair  of  scalar  differential  equations  for  the  image-point  coordinates: 


x  =  -  Dvj/Z  +  xvj/Z  +  xy©x/D  -  (x2  +  D2)  ©y/D  +  y©*  , 

(7) 

y  «  -  Dvy/Z  -  yVj/Z  +  (y2  +  D2)  ©j/D  -  xy©y/D  -  x©j  . 


Since  the  FOE,  by  definition,  is  the  point  that  remains  stationary  when  the  sensor 
does  not  rotate,  its  location  can  be  obtained  from  (7)  by  setting  the  left-hand  sides  and  the 
components  of  ©  equal  to  zero.  That  is,  the  FOE  will  have  the  image  coordinates  (Dvx/vz, 
Dvy/vj).  In  fact,  with  zero  rotation  and  nonzero  translation,  for  any  image  point  the  optical 
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flow  line  obtained  by  extension  from  the  instantaneous  flow  direction  at  the  point  will  have 
the  equation,  in  toms  of  (xi,yj)  coordinates  measured  in  units  equal  to  D: 

yi  =  vy/v2  +  m(xi  -  Vx/Vz)  ,  (8) 

where  one  has 

dy 

m"dx  ’ 

evaluated  at  the  image  point  All  such  lines  obtained  in  the  same  way  from  all  image  points 
will  intersect  at  the  FOE. 


In  principle,  in  the  general  case  when  rotation  does  occur,  (7)  provides  the  means 
of  determining  some  but  not  all  of  the  unknown  velocity  and  rotation  vector  components. 
In  practice,  it  would  be  necessary  to  solve  the  differential  equations  numerically  in  terms  of 
image  measurements  made  over  a  time  interval  short  enough  to  insure  that  the  instantaneous 
velocities  do  not  change  significantly.  Otherwise,  the  FOE  and  the  velocities  would  vary 
during  the  interval  and  would  have  to  be  treated  as  functions  of  time. 

Thus,  (7)  can  be  regarded  as  equivalent  to  an  algebraic  system  of  equations 
obtained  by  multiplying  both  sides  by  the  time  interval  dt  Then  the  derivatives  on  the  left- 
hand  side  can  be  replaced  by  distances  dx  and  dy.  Similarly,  on  the  right-hand  side  the 
velocity  vector  components  can  be  replaced  by  displacement  components,  and  the  rotation 
vector  components  can  be  replaced  by  angular  displacements. 

Although  it  should  be  kept  in  mind  that  the  unknown  velocity  vectors  have  been 
replaced  by  displacements,  with  little  danger  of  confusion  the  notation  for  their  components 
can  remain  the  same.  Also,  it  is  evident,  after  dividing  both  sides  of  the  equations  by  D, 
that  D  can  be  set  equal  to  1;  this  amounts  to  an  understanding  that  image  distances  are  to  be 
expressed  in  units  equal  to  D. 

It  is  possible  to  eliminate  the  unknown  distance  z  from  the  two  equations  by 
transposing  all  terms  on  the  right-hand  side  containing  rotation  components  to  the  left-hand 
side  and  dividing  die  second  equation  by  the  first  The  result  is 

dy  - (y2  + 1)  <ox  +  xy©y  +  xoij  Vy-yv2  /m 

"  ^  '  *  mj  M  MV 

dx  -  xyo>x  +  (xz  +  1)  C0y  -  ycoz  *  z 


For  every  mutual  image  point  in  the  two  frames  observed  by  the  sensor,  it  is 
possible  to  write  an  equation  of  the  form  given  by  (9).  On  dividing  the  numerator  and 
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denominator  of  the  right-hand  side  by  the  magnitude  v  of  v  it  is  evident  that,  whatever  the 
number  of  the  image  points  contributing,  the  resulting  system  of  equations  can  only 
determine  the  direction  of  v,  and  not  its  magnitude.  Thus,  as  in  the  case  of  the  photo- 
grammetric  equations  based  on  coplanarity,  five  unknowns  associated  with  the  sensor's 
rotation  and  its  translation  direction  can  be  determined,  in  principle,  by  data  obtained  from  a 
minimum  of  five  image  points. 

Dividing  by  vz  instead  of  v  and  multiplying  through  by  the  denominators  on  both 
sides  reduces  the  system  to  a  system  of  quadratic  equations  for  the  unknowns: 

(y^Dvico*  -  xyviCOy  -  xvitDz  -  xyv2C0x  +  (x2+l)  V2C0y  -  yv2C0z  -  xco*  -  ycoy 

+  (x^+y2)  £02  -  vidy  +  V2dx  +  xdy  -  ydx  =  0 ,  (10) 

where  it  has  been  assumed  that  vz  is  not  zero,  vi  has  been  written  for  the  ratio  vx/vz>  and  V2 
has  been  written  for  the  ratio  vy/vz.  Geometrically,  a  solution  corresponds  to  the 
intersection  of  five  four-dimensional  quadric  manifolds,  which,  in  fact,  have  hyperbolic 
two-dimensional  cross  sections.  Thus,  with  the  use  of  only  five  image  points  for  data  the 
solution  may  not  be  unique. 

If  as  many  as  1 1  image  points  contribute  to  the  data  in  (10),  thereby  furnishing  a 
system  of  1 1  equations,  the  problem  changes  from  solving  a  quadratic  system  to  solving 
one  that  is  linear.  It  is  only  necessary  to  treat  as  independent  unknowns  the  quantities 

Vl©x,  VlCOy,  VitOz,  V2 ©x,  V2©y,  V20>x.  ©x,  ©y»  ©z,  Vi,  V2- 

Reference  4  uses  relations  that  are  essentially  the  same  as  (7),  along  with  the  fact 
that  the  linear  extensions  of  the  displacements  (dx,  dy)  at  all  image  points  must  intersect  at 
the  FOE,1  to  separate  the  translational  and  rotational  effects  of  the  sensor  motion  on  the 
optical  flow.  The  calculation  involves  adjusting  the  components  of  to  to  minimize  an  error 
function  defined,  for  a  set  of  extended  lines  in  the  flow  directions,  as  the  mean  square 
separation  of  the  points  where  the  lines  in  the  set  intersect  a  single  extended  flow  line 
chosen  arbitrarily.  This  process  determines  the  FOE  coordinates  if  the  set  contains  enough 
lines. 

The  method  depends  on  a  sequence  of  iterations  which,  with  luck,  will  converge 
reasonably  quickly  to  a  result  that  gives  the  true  FOE  position.  Although  some  numerical 
examples  encourage  the  hope  that  this  will  be  the  case  in  general,  confidence  in  the  method 


1  This  fact  is  not  independent  of  (7).  It  is  used  only  to  define  an  error  function  that  the  solution 
algorithm  of  Ref.  4  attempts  to  minimize. 
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requires  faith  not  only  in  its  quick  convergence  but  also  in  its  convergence  to  the  correct 
result  That  the  calculation  provides  the  true  FOE  is  not  a  foregone  conclusion  because, 
although  a  minimum  for  the  error  function  clearly  must  exist  it  is  conceivable  that  the 
function  may  have  two  or  more  local  minima  corresponding  to  points  other  than  the  FOE. 

Knowing  the  FOE  position  is  equivalent  to  knowing  the  direction  but  not  the 
magnitude  of  the  coordinate-system  translation  during  the  sensor  motion.  The  solution  of 
(10),  or  the  calculation  of  Ref.  4,  also  provides  an  estimate  of  the  coordinate-system 
rotation,  the  effect  of  which  can  be  removed  from  the  combined  coordinate  transformation. 
However,  Appendix  A  of  this  paper  derives  what  appears  to  be  a  more  efficacious  method 
for  calculating  the  coordinate-system  translation  direction  and  rotation  than  the  approaches 
suggested  thus  far. 

In  any  event,  whatever  the  means  employed,  the  first  objective  is  to  acquire  the 
coordinate-system  transformation  and  remove  the  rotational  part  Then,  for  a  given  object 
point,  if  r  and  r'  are  radius  vectors  to  the  corresponding  image  points  in  the  frames  before 
and  after  the  translation,  the  standard  photogrammetric  procedure  described  in  Section  II 
can  be  used  as  follows  to  locate  the  object  point 

The  condition  that  lines  in  the  directions  of  r  and  r'  must  intersect  at  the  object 
point  can  be  expressed  as 

R  =  v  +  R’  ,  (11) 

where  R  and  R’  are  vectors  to  the  object  point  from  the  projection  centers  before  and  after 
the  translation  and  where  v  is  die  translation  vector,  which  is  the  product  of  the 
translational  velocity  and  the  time  interval  of  the  motion.  The  vectors  R  and  R'  have  the 
same  directions  as  the  image-point  vectors  r  and  r'. 

The  objective  is  to  calculate  the  range,  which  is  the  magnitude  R’  of  the  vector  R'. 
For  this  purpose,  the  following  pair  of  equations  can  be  obtained  from  (11),  first  by  taking 

the  cross  product  of  both  sides  with  v  and  then  by  taking  the  cross  product  of  both  sides 
with  Iq,  which  is  the  unit  vector  in  the  direction  of  R’: 

Rv  x  rQ  =  R’v  xrj,  , 

Rr0  x  rj)  =  v  x  r*0  .  (12) 

Relative  to  some  polar  coordinate  system  in  the  plane  defined  by  the  three  vectors 
R,  R',  v,  the  respective  angular  coordinates  of  the  vectors  will  be  denoted  by  8, 8',  8V. 
Then,  since  all  of  the  cross  products  in  (12)  are  mutually  parallel  vectors  (orthogonal  to  the 
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plane  determined  by  R,  R',  v),  the  equations  in  (12)  are  equivalent  to  the  two  scalar 
equations 

Rsin(8v  -  0)  =  R'sin(0v  -  0')  , 

Rsin(0  -  0')  =  vsin(0v  -  0’)  .  (13) 


Substituting  from  the  second  equation  of  (13)  into  the  first  and  solving  leads  to  the  formula 


vsin(8v  -  8) 
sin(0  -  0') 


(14) 


for  the  range. 


Except  for  notation,  Eq.  (14)  is  identical  to  the  formula  for  range  given  in  Ref.  2, 
which  proposes  to  use  algorithms  based  on  optical  flow  to  do  passive  ranging  with  a  FLIR 
from  an  aircraft  platform.  It  is  clear  from  (14)  that  the  magnitude  and  the  direction  of  the 
platform's  translational  velocity  are  required  to  accomplish  this  end.  However,  as 
observed  earlier,  optical  flow  data  can  only  yield  the  velocity  direction.  Therefore, 
additional  information,  such  as  the  velocity  magnitude  or  some  kind  of  ground  truth  in 
terms  of  known  object  control  points  like  those  in  ordinary  photogrammetric  usage,  is  also 
necessary. 
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IV.  ERRORS 


As  remarked  at  the  end  of  Section  n,  when  the  observation  of  overlapping  image 
data  takes  place  in  scenes  viewed  from  directions  that  are  nearly  the  same,  object-point 
location  estimates  derived  from  the  data  will  be  particularly  sensitive  to  measurement 
errors.  This  condition  is  inherent  in  the  optical  flow  methodology  because  it  relies  on  data 
due  to  small  changes  in  image-point  positions.  Therefore,  measurement  errors  are,  if 
anything,  more  important  for  a  passive  ranging  technique  based  on  optical  flow  than  for 
one  based  on  classical  photogrammetry,  the  standard  procedures  of  which  are  aimed  at 
insuring  the  opposite  condition. 

Reference  1  (e.g.,  pp.  478-483,  486-488)  deals  extensively  with  error  contri¬ 
butions  to  photogrammetry.  However,  the  literature  concerned  with  similar  applications  of 
image  measurement,  using  other  approaches  such  as  optical  flow  theory,  has  largely 
ignored  such  considerations. 

Optical  systems  inevitably  contribute  errors  that  are  important  in  these  applications, 
for  passive  ranging  in  particular.  As  indicated  in  Ref.  1,  it  is  not  only  necessary  to  correct 
certain  errors  that  the  sensor  causes,  but  in  order  to  do  so  it  is  also  necessary  to  obtain  the 
data  for  that  purpose  by  applying  specific  calibration  procedures  to  the  optical  equipment 
Reference  1  (pp.  232-274)  treats  in  some  detail  standard  methods  of  calibrating  aerial 
cameras. 

Reference  1  lists  the  following  errors,  most  of  which  must  occur  in  any  optical 
system,  no  matter  what  its  purpose  may  be.  Some  appear  specific  to  the  particular 
equipment  used  in  photogrammetry;  however,  these  also  have  their  counterparts  in  other 
imaging  devices. 

A.  PRINCIPAL  POINT  COORDINATE  DISPLACEMENTS 

Errors  in  both  the  focal  length  and  the  optical  center,  referred  to  as  the  principal 
point,  are  significant  and  occur  even  in  aerial  cameras  providing  fiduciary  marks  that 
supposedly  point  toward  the  center.  In  addition,  image  distortion  may  require  an 
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adjustment  from  what  is  called  the  effective  focal  length  of  the  optical  system  to  a  more 
operationally  accurate  value  called  the  calibrated  focal  length. 

A  preflight  calibration  can  determine  these  effects  quantitatively.  The  resulting  data 
must  be  applied  to  adjusting  coordinates  relative  to  the  coordinate  systems  used  in 
processing  the  image  data  observed  by  the  sensor. 

B.  DISTORTION 

Image  distortion  results  primarily  from  two  sources:  imperfect  lens  design  and 
decentered  lens  elements.  It  is  also  customary  to  distinguish  two  types:  radial,  which  is 
symmetric  about  the  optical  center  in  the  image  plane,  and  tangential,  which  is  only 
symmetric  about  a  line  through  the  optical  center. 

Analytical  distortion  models,  involving  a  small  number  of  parameters  that  can  be 
obtained  from  calibration  measurements,  are  useful  both  for  correcting  image  data  and  for 
estimating  the  effect  of  distortion  on  image  errors.  For  the  radial  type,  the  model  is  usually 
a  polynomial  in  odd  powers  of  die  radial  distance  from  the  optical  center.  For  the  tangential 
type,  the  model  involves  a  polynomial  in  both  odd  and  even  powers  of  the  radial  distance 
multiplied  by  a  linear  combination  of  the  sine  and  cosine  of  the  angle  measured  from  a  line 
emanating  from  the  optical  center. 

C.  EMULSION  DEFORMATION 

This  error  source  occurs  with  aerial  cameras  because  photographic  material,  film  or 
glass,  is  subject  to  deformation  between  exposure  and  development  Although  a  sensor, 
such  as  a  FUR,  that  records  or  transmits  image  data  by  other  than  photographic  means  will 
not  suffer  from  precisely  the  same  effect,  it  will  undoubtedly  encounter  one  that  is  similar 
enough  to  require  the  same  kind  of  correction.  For  example,  errors  may  exist  in  the 
alignment  or  lateral  positioning  of  detector  elements. 

With  a  scanning  device  nonuniformities  in  the  scan  motion  may  also  produce  an 
image  distortion  effect  reminiscent  of  that  due  to  film  emulsion.  To  correct  distortion 
resulting  from  dynamic  sources,  it  may  be  necessary  to  make  in-flight  calibration 
measurements  for  the  requisite  data. 
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D.  PLATEN  CURVATURE 


The  camera  pressure  platen  that  is  supposed  to  keep  the  film  in  a  plane  orthogonal 
to  the  optical  axis  may  be  imperfectly  machined  and  therefore  have  small  undulations.  An 
array  of  detectors  in  an  IR  senses’  may  have  a  similar  defect 

E.  ATMOSPHERIC  REFRACTION 

Variations  in  the  atmospheric  index  of  refraction  cause  rays  from  object  points  to 
bend  in  accordance  with  Snell's  law.  Generally,  the  index  of  refraction  is  horizontally 
stratified;  i.e.,  it  varies  with  height  rather  than  laterally.  Aside  from  a  static  index  of 
refraction  distribution  that  persists  for  relatively  long  periods  of  time,  there  are  also  rapid 
fluctuations,  due  to  turbulence,  that  produce  statistical  fluctuations  in  the  ray  pathlengths. 
Not  only  can  this  effect  cause  defocusing,  but  it  may  also  shift  a  focus,  i.e.,  an  image 
point,  laterally. 
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V.  ERROR  PROPAGATION 


When  a  function  depends  upon  two  or  more  independent  parameters  that  have  small 
errors,  the  corresponding  error  in  the  function  is  approximately  equal  to  the  sum  of  the 
errors  contributed  by  the  individual  parameters.  To  the  same  order  of  approximation,  the 
error  contributed  by  a  single  parameter  is  equal  to  the  parameter  error  multiplied  by  the 
derivative  of  the  function  with  respect  to  the  parameter.  To  obtain  the  fractional  (or 
percent)  error,  it  is  only  necessary  to  replace  the  derivatives  by  logarithmic  derivatives. 

Thus,  the  fractional  error  e  in  the  range  estimate  derived  from  optical  flow  theory 
and  given  by  (14)  is  approximately  equal  to  the  sum  of  the  error  contributions  ev,  eee\  eve 
from  v  and  the  angle  differences  0  -  0',  0V  -  0.  That  is 

e  «  ey  +  ev®  +  eee’  .  (15) 

where 

ey  *  ey/v,  eye  »  eye  cot(0v  -  0),  eee*  ■  -  eee*  cot(0  -  0’) , 

and  the  quantities  ev.  Eye,  eee'  are  the  absolute  errors  in  v  and  the  angle  differences  0V  -  0, 
0-0'. 

It  is  obvious  from  (15)  that  when  the  angle  differences  are  small,  the  fractional 
range  error  is  very  sensitive  to  errors  in  those  differences.  On  the  other  hand,  in  the  first 
frame  the  angle  between  the  optical  axis  and  the  ray  to  the  object  point  will  be  small  when 
the  field  of  view  is  narrow,  e.g.,  in  the  passive  ranging  case.  These  factors  seem  to 
contradict  a  remark  in  Ref.  2  to  the  effect  that  the  algorithm  used  in  the  passive  ranging 
method  employed  there  is  optimal  when  the  angle  between  the  velocity  direction  and  the 
optical  axis  is  near  zero. 

At  tile  very  least,  the  term  "optimal"  appears  to  be  an  exaggeration.  As  indicated  in 
Ref.  1,  for  the  ideal  photogrammetric  condition  the  view  is  vertical  (p.  53)  and  the  platform 
motion  is  horizontal  (p.  55),  which  is  a  rule  of  thumb  that  (15)  supports. 

That  is,  if  the  velocity  direction  is  perpendicular  rather  than  parallel  to  the  optical 
axis,  then  the  angular  difference  0V  -  0  will  be  close  to  90  deg.  Thus,  in  this  case  on  the 
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right-hand  side  of  (15),  the  second  term,  which  is  the  only  one  that  depends  explicitly  on 
the  velocity  direction,  will  indeed  be  small. 

To  trace  the  effect  of  image-point  position  error  on  the  range  error,  it  is  only 
necessary  to  express  the  angle  differences  in  the  last  two  terms  on  the  right-hand  side  of 
(15)  as  functions  of  the  FOE  and  the  image-point  coordinates.  Then  the  quantities  eve,  eee' 
can  be  calculated  in  terms  of  derivatives  of  those  functions. 

If  £  is  the  two-dimensional  radius  vector  from  the  origin  of  the  image-plane 
coordinate  system  to  an  image  point  in  the  first  frame  and  £'  is  that  from  the  origin  of  the 
translated  image-plane  coordinate  system  to  an  image  point  in  the  second  frame,  then 
according  to  (4),  normalized  by  setting  D  equal  to  1,  one  has 

R/z  =  £+  k 

and  (16) 

R’/z' *£•-»- k  . 

Equations  (16)  determine  the  relation  between  the  image-point  positions  and  the  angle 
difference  0-8'  appearing  in  (15). 

The  cross  product  of  the  left-  and  right-hand  sides  of  the  first  equation  in  (16)  with 
the  corresponding  left-  and  right-hand  sides  of  the  second  equation  leads  to 

R  x  R’/zz'  =  pxp'  +  pxk  +  kxp'.  (17) 

Taking  the  magnitude  of  the  vector  expression  on  each  side  of  (17),  keeping  in 
mind  that  p  and  p'  are  both  orthogonal  to  k,  gives  the  desired  relation  in  terms  of  the 
image-point  polar  coordinates  (p,  00  and  (p‘,  0.): 

I  sin(0  -  8’)  U  sin2(A0.)  +p2+p’2- 2pp'  cos  (A0.)  ,  (18) 

where  A0j  has  been  written  for  the  angle  difference  0.  -  0'.  . 

From  the  fact  that  the  two-dimensional  image  plane  radius  vector  £p  to  the  FOE  is 
given  by 

pP  +  k  =  v/vr  ,  (19) 

mm 

a  similar  relation  can  be  derived  for  the  angle  difference  0V  -  8  in  terms  of  the  polar 
coordinates  (p,  00  for  image  point  and  (pf,  0f)  for  the  FOE.  That  is,  taking  the  cross 


where  C  is  a  constant  that  has  no  effect  on  the  fractional  error  contribution,  will  do  for  both 
(18)  or  (20).  Also,  the  result  obtained  for  one  radial  coordinate  pi  will  do  for  the  other 
radial  coordinate,  and  the  result  obtained  for  one  angle  difference  A0  will  do  for  the  other 

*  angle  difference. 

In  accordance  with  the  general  principle  stated  earlier,  a  logarithmic  derivative  of  the 
right-hand  side  of  (18)  or  (20)  with  respect  to  an  image- point  parameter,  multiplied  by  the 
^  parameter  error,  gives  the  contribution  of  the  parameter  error  to  the  fractional  error  of  the 

quantity  on  the  left-hand  side.  On  the  other  hand,  it  is  clear  from  (14)  that  the  logarithmic 
derivatives  of  the  left-hand  sides  of  (18)  and  (20)  contribute  in  the  same  way  to  the 
fractional  error  in  the  estimated  range. 

#  Thus,  there  are  only  two  cases:  the  radial  contribution  Fp(pi,  p2,  A0)  given  by  the 
logarithmic  derivative  of  (21)  with  respect  to  pi  and  the  angle  difference  contribution 
Fe(pi,  p2,  A0)  given  by  the  logarithmic  derivative  of  (21)  with  respect  to  A0.  These 
quantities  are 
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Fp(pi,  P2>  A0)  =  (Pl[P2  sin2(A0)  +  1]  -  P2  cos(A0)}/D 


and 


Fe(pi,  p2>  A0)  =  [pf P2  sin(A0)cos(A0)  +  piP2sin(A0)]/D, 


(22) 


where 


0  =  Pjp^  sin2  (A0)  +  Pj  +  pj  -  2pip2COS(A0)  . 


Note  that  the  fractional  range  error  given  by  (15)  can  be  written 


e  =  ev/v  +  e(p)  [Fp(p,  pp,  0f  -  00  -  Fp(p,  p',  0j  -  0j)]  +  e(p’)  Fp(p',  p,  0i  -  0!) 

+  e(pF)  Fp(pp,  p,  0f  -  60  -  e(0i)  [Fe(p,  p‘,  0i  -  0j)  +  Fe(p,  pF,  0f  “  901  (23) 


+  e(0'i)F0(p,  p\  0i  -  0j)  +  e(0p)  Fe(p,  pp,  0f  -  00 


in  terms  of  absolute  errors  e(p),  e(p'),  e(pF),  e(0i),  e(0'.),  e(0f)  in  the  image-point  and 

# 

FOE  radial  and  angular  coordinates. 

The  error  factors  Fp(pi,  p2,  A0)  and  Fe(pi,  p2,  A0)  will  both  be  greatly  magnified 
for  parameter  values  that  make  the  denominator  D  in  both  equations  of  (22)  small,  unless 

•  they  also  cause  the  numerators  to  decrease  at  the  same  rate.  On  setting  D  equal  to  zero,  it 
will  be  found  that  only  when  the  radial  coordinates  pi  and  p2  are  equal  will  a  real  angle 
solution  of  the  resulting  equation  for  A0  exist  and  that  the  only  solution  in  that  case  is 
A0  »  0. 

•  In  the  limit  of  small  A0,  dropping  powers  of  A0  higher  than  the  first,  (22)  becomes 


Fp(pi,  p2.  A0)  -  l/(pi  -  p2)  , 

Fe(pl,  p2>  A0)  -  A0pip2(l  +  PlP2V(Pl  “  P2)2-  (24) 


22 


It  is  evident  from  (24)  that  the  case  pi  =  p2  is  singular  for  both  angular  and  radial  image 
coordinate  errors. 

However,  the  angular  coordinate  error  contribution  shrinks  if  the  angle  difference 
or  either  radial  coordinate  decreases  but  the  radial  coordinate  error  contribution  does  not 
Thus,  for  some  geometric  configurations  radial  image-point  and  FOE  coordinate  errors  are 
more  dangerous  than  angular  coordinate  errors.  This  is  a  particularly  true  when  the  radial 
coordinate  values  are  small,  which  is  always  the  case  for  the  image  points  when  the  field  of 
view  is  narrow. 

The  angular  errors  in  (23)  are  errors  in  the  difference  between  two  angle 
coordinates.  Therefore,  errors  in  the  angle  coordinates  of  such  a  pair  will  tend  to  cancel  out 
if  they  are  in  the  same  direction  and  have  nearly  the  same  magnitude.  This  may  very  well 
be  the  case  for  some  errors  due  to  fixed  imperfections  in  the  sensor's  optical  system. 

Radial  distortion  due  to  an  imperfect  lens  design  will  cause  errors  only  in  the  radial 
image-point  coordinates.  Tangential  and  other  less  symmetric  types  of  distortion,  which 
occur  for  various  different  reasons  mentioned  in  Section  IV,  can  cause  errors  in  both  the 
radial  and  the  angular  image-point  coordinates. 

Since  both  p  and  p'  will  be  small  for  a  narrow  field  of  view,  (24)  does  not  support 
the  Ref.  2  claim  that  an  optimal  sensor  velocity  direction  is  one  nearly  parallel  to  the  optical 
axis  because  that  condition  implies  a  small  value  for  pp.  On  the  other  hand,  (24)  does  tend 
to  support  the  Ref.  1  recommendation  that  the  velocity  vector  be  orthogonal  to  the  optical 
axis,  which  implies  a  large  value  for  pp. 


m 
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VI.  RANGING  ACCURACY 


This  section  examines  in  more  detail  the  effect  of  the  error  propagation  estimates 
obtained  in  Section  V  on  die  accuracy  of  target  ranging  by  means  of  passive  image  sensing. 
The  discussion  covers  some  general  relations  between  the  error  and  various  geometric 
parameters  that  determine  its  magnitude.  The  results  applied  to  numerical  examples  fen1  two 
typical  cases  illustrate  the  dependence  of  ranging  accuracy  on  geometry  and  the  limitations 
thereby  imposed  in  a  particular  application. 

It  is  assumed  that  the  sensor  platform  at  an  altitude  h  moves  with  a  constant  velocity 
v  parallel  to  the  ground.  It  is  also  assumed  that  the  optical  axis  lies  in  the  plane  of  the 
velocity  vector  and  the  vertical,  that  the  object  point  for  which  the  range  is  required  is  on 
the  ground,  and  that  the  object  point  too  lies  in  die  same  plane. 

For  the  sake  of  completeness,  Appendix  B  discusses  the  more  general  case  in 
which  the  last  two  assumptions  are  dropped.  However,  no  significant  difference  will  be 
found  between  the  general  case  and  the  more  specialized  case  considered  in  this  section, 
and  the  results  obtained  here  should  approximate,  well  enough  to  be  regarded  as  entirely 
representative,  most  situations  likely  to  be  encountered  in  practice. 

Figure  3  illustrates  the  geometrical  configuration.  It  shows  the  X-Z  plane  of  the 
optical  coordinate  system  at  two  sensor  positions  separated  by  a  time  interval  t,  with  the  Z 
axis  and  the  optical  axis  assumed  to  be  coincident  as  usual. 

The  object  point  observed  from  the  first  sensor  position  is  at  a  distance  Ri,  to  be 
estimated  by  photogrammetzic  oar  optical  flow  analysis,  in  a  direction  given  by  the  angle  61 
relative  to  the  Z,  or  optical,  axis.  As  indicated  in  the  figure,  the  line  connecting  the  sensor 
and  the  object  point  also  makes  an  angle  yi  with  the  horizontal.  The  same  object  point 
viewed  by  the  sensor  in  its  second  position  makes  an  angle  62  with  the  new  position  of  the 
optical  axis,  and  the  line  connecting  the  sensor  in  the  second  position  with  the  object  point 
makes  an  angle  \|/2  with  the  horizontal  The  lines  connecting  the  sensor  in  the  two  different 
positions  with  the  object  point  meet  in  an  angle  a. 


OBJECT 

m;««  POINT 


Figure  3.  Image  Angie  Change  During  a  Translation. 

It  is  evident  that  when  the  sensor  is  in  the  first  and  second  positions  the  radial 
coordinates  pi,  p2  of  the  image  points  corresponding  to  die  object  point  are  given  by 

pi  * tan  0i  , 

P2  =  tan  82  •  (25) 

It  is  also  evident  that 

01  +  Vl  =  02  +  V2  > 

from  which  it  follows  that 

82*81  -  a  . 

Therefore,  the  Eqs.  (25)  become 

pi* tan 0i  , 

P2  =  tan (9i -a)  .  (26) 

That  is, 

P2  =  (pi -tan  a)/(l +pi  tan  a) .  (27) 
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According  to  (24)  in  Section  V,  the  fractional  error  propagation  factor  is  given  by 
die  reciprocal  of  pi  -  p2-  Therefore,  the  value  of  this  quantity  is  a  primary  interest  From 
(27)  it  follows  that 

pi  -  p2  -  [(Pi  +  1)/(1  +  pi  tan  a)]  tan  a  .  (28) 


For  a  sensor  with  a  narrow  field  of  view  pi  «  1.  If  a  is  acute  and  not  near  90  deg,  then 
(28)  implies  that 

pi  -  P2  ~  tan  a  .  (29) 

It  can  be  seen  from  Fig.  3  that 

Ri  sin  a  =  vt  sin  (\yi  +  a)  , 


from  which  it  follows  that 


tan 


a  *  vth^Rj  -  vt  ^/Rj  -  h2  j  . 


(30) 


It  is  evident  from  (24)  and  (29)  that  (30)  expresses  a  fundamental  relationship  between  the 
error  and  the  important  configuration  parameters. 

From  its  derivative  with  respect  to  t  in  (30),  it  can  be  seen  that  tan  a  increases,  and 
therefore  that  the  error  decreases,  monotonically  as  the  time  interval  t  between  observations 
increases.  In  fact,  tan  a  becomes  infinite,  thereby  reducing  the  error  factor  to  zero,  when 

t «  R*  /[vJk]  -  h2)  . 


However,  it  is  easy  to  see  from  Fig.  3  that  the  object-point  image  will  be  observable  over 
this  time  interval  only  if  the  sensor  field  of  view  is  at  least  90  deg.  In  this  event,  since  the 
corresponding  value  of  pi  would  be  at  least  1,  the  first-case  approximation  of  (29)  would 
not  be  valid,  but  the  exact  Eq.  (28)  would  give  pi  +  1/pi  for  the  error  factor. 


Thus,  the  error  factor  is  limited  by  the  interval  t  between  observation  times,  and  t  is 
limited  either  by  the  sensor  field  of  view  or  by  the  requirement  that  the  velocity  remain 
constant  during  the  interval.  Assuming  that  the  velocity  can  be  held  constant,  Fig.  3  shows 
that  the  maximum  possible  value  of  a  is  the  field-of-view  angle  <Pfov»  in  terms  of  which 
the  required  time  interval  tMAX  would  be  given  by 


Wx 


Rj  tan 


9poV/  v[h  +  tan(ppov>/^V) 


(31) 
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By  differentiating  the  right-hand  side  of  (30)  with  respect  to  Ri  and  setting  the 
result  equal  to  zero,  the  object-point  range  at  which  the  value  of  tan  a  is  maximized,  and 
therefore  the  error  is  minimized,  can  be  found  in  terms  of  a  specified  time  interval  between 
observations  and  the  platform  velocity  and  altitude.  If  vt  <  2h,  the  result  is  given  by 

RMXX  =  Vh2+  (vt/2)2  ;  (32) 

2 

otherwise,  for  two  values  of  Rj  , 

Rj  =  vt  [vt  ±  i/  (vt)2  -  4h2]  f2  , 

tan  a  is  infinite.  The  value  of  tan  a  corresponding  to  (32)  is  given  by 

tan  ccmax  =  vth/[h2  -  (vt/2)2] ,  (33) 

which  is  a  maximum  if  vt  <  2h. 

Actually,  it  is  obvious  from  the  geometry  that,  independently  of  the  range,  the  time 
interval  t  must  not  be  less  than  a  certain  duration  for  a  given  value  of  tan  a.  To  find  this 
minimum  value  of  t,  the  first  step  is  to  solve  (30)  for  Rj,  obtaining 


2h  cot  a  +  vt  ±  v  (vt)  +  4vth  cot 


* 

a-4h2]/2'  . 


To  get  a  real  value  for  Ri  it  is  clear  from  (34)  that  the  condition 

(vt)2  +  4vth  cot  a  -  4h2  >  0 

must  be  satisfied.  A  little  manipulation  shows  that  (35)  is  equivalent  to 

t  £  (2h/v)  tan  a/2  ~  (h/v)  tan  a . 

For  the  minimum  time  interval  given  by  (36),  the  range  is  given  by 

Ri  -  (h  sec  a)/2, 


which  implies  the  geometrically  obvious  fact  that  for  the  image  point  to  remain  within  the 
field  of  view,  it  must  lie  in  a  nearly  vertical  direction  relative  to  the  platform  velocity. 

The  argument  leading  to  (31)  implies  that  the  maximum  value  of  tan  a,  and 

•  therefore  the  minimum  error,  occurs  when  the  time  duration  t  is  such  that  the  image  moves 
exactly  across  the  field  of  view.  This  fact,  combined  with  the  implication  of  (37),  clearly 
supports  the  standard  photogrammetric  procedure  of  looking  down  rather  than  forward  to 
obtain  mapping  accuracy,  since  that  procedure  leads  to  the  shortest  required  time  interval 

•  between  frames  for  a  given  error  factor. 
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It  is  instructive  to  use  (24)  and  (30),  along  with  (23),  in  some  numerical  examples 
that  illustrate  how  sensitive  the  range  error  due  to  optical  image  distortion  alone  may  be  to 
typical  geometrical  and  physical  parameters.  Tables  1  and  2  present  the  limits  on  radial 
distortion  that  would  be  necessary  to  obtain  90  percent  accuracy  in  a  range  estimate  based 
on  data  observed  from  two  different  sensor  platforms.  One,  moving  with  slow  speed  at  a 
low  altitude,  is  consistent  with  a  helicopter,  and  the  other,  moving  faster  at  a  higher 
altitude,  is  consistent  with  a  light  aircraft  The  tables  indicate  clearly  how  difficult  it  should 
be  to  obtain  accurate  range  estimates  using  a  sensor  with  a  narrow  field  of  view  when  the 
data  provided  by  the  sensor  is  based  on  images  viewed  within  a  short  time  interval 

The  results  shown  in  the  tables  are  given  for  various  angular  positions  of  the  object 
point  relative  to  the  optical  axis  when  observed  in  die  first  of  two  frames.  The  results  are 
also  given  for  the  two  cases  in  which  the  time  interval  between  the  two  frames  is  either 
1  second  or  2  seconds. 


Table  1.  Maximum  Image  Distortion  (mrad)  for  a  10  Percent  Range  Error; 
Platform  Altitude  30  m,  Velocity  50  knots 


Maximum  Image  Distortion,  mrad 

500  m 
Range 

1,000  m 
Range 

1,500  m 
Range 

0.326 

0.079 

0.035 

0.689 

0.163 

0.071 

0.239 

0.080 

0.035 

0.696 

0.165 

0.072 

B 

0.083 

0.036 

0.719 

isa 

0.074 

Table  2.  Maximum  Image  Distortion  (mrad)  for  a  10  Percent  Range  Error; 
Platform  Altitude  500  m,  Velocity  200  knots 


Initial  Image 

Time, 

sec 

Maximum  Image  Distortion,  mrad 

Angle  Off 
Optical  Axis, 
deg 

3,000  m 
Range 

5,000  m 
Range 

10,000  m 
Range 

2 

1 

0.593 

mm 

■ 

.052 

2 

1.228 

0.430 

0.105 

6 

1 

1 

.598 

0.212 

1 

.053 

2 

1.239 

0.434 

0.106 

12 

1 

1 

.618 

0.220 

0.054 

2 

1.279 

0.448 

0.110 
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VH.  SUMMARY  AND  CONCLUSIONS 


With  two-dimensional  image  data  obtained  passively  at  two  different  sensor 
locations  and  certain  other  information,  it  is  possible  to  locate  the  position  of  an  object  point 
fixed  in  three-dimensional  space  relative  to  either  sensor  position.  The  required  additional 
information  is  equivalent  to  knowledge  of  the  transformation  between  fixed  optical 
coordinate  systems  at  the  two  sensor  positions. 

Six  independent  parameters  characterize  the  transformation:  three  components  of  a 
linear  displacement  plus  a  rotation  through  some  angle  about  an  axis  which  two  other 
angles  determine.  Image  data  alone,  observed  at  the  two  sensor  locations,  can  yield  five  of 
the  six  transformation  parameters,  but  not  the  remaining  one. 

When  the  two  sensor  positions  are  those  of  a  single  moving  sensor  at  the  beginning 
and  the  end  of  a  known,  sufficiently  short  time  interval,  a  calculation  based  on  the  concept 
of  optical  flow  theory  can,  in  principle,  give  the  five  obtainable  transformation  parameters. 
In  general,  a  system  of  at  least  five  quadradcally  coupled  algebraic  equations,  which  can  be 
set  up  if  data  from  at  least  five  image  points  and  their  optical  flow  displacements  are 
available,  will  determine  those  quantities. 

It  may  also  be  possible  to  calculate  them  as  part  of  the  solution  of  a  system  of  1 1 
linear  algebraic  equations,  which  can  be  set  up  with  similar  data  from  at  least  1 1  image 
points.  However,  if  data  from  at  least  nine  image  points  are  available,  the  method  derived 
in  Appendix  A  will  provide  a  closed-form  solution  for  the  five  transformation  parameters. 

A  common  method  used  in  photogramme  try  to  obtain  map  scale  can  determine  the 
remaining  transformation  parameter,  but  it  requires  knowledge  of  the  actual  locations  of 
three  known  control  points  imaged  in  a  single  stationary  scene  observed  by  a  sensor. 
Otherwise,  the  procedure  based  on  optical  flow  can  determine  the  direction  but  not  the 
magnitude  of  the  moving  sensor's  velocity. 

A  number  of  error  sources  are  associated  with  the  optical  characteristics  of  any 
imaging  sensor  and  contribute  to  the  error  in  estimating  the  position  of  an  object  in  space: 
its  range,  in  particular.  To  estimate  range  with  any  accuracy,  it  is  necessary  to  perform 
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certain  preflight  and  possibly  in-flight  calibrations  of  the  optical  equipment  to  account  for 
some  of  the  distortion  introduced  into  the  image  data.  Algorithms  for  calculating  the  range 
must  take  into  account  the  information  acquired  by  this  means. 

In  general,  for  best  results  the  displacement  between  the  two  sensor  positions 
should  be  perpendicular  to  the  optical  axis  after  the  effect  of  any  rotation  is  removed  from 
the  image  data.  That  is,  the  sensor  motion  should  be  such  that  the  FOE  lies  well  outside  the 
field  of  view. 

When  the  two  images  used  to  estimate  the  range  of  an  object  point  are  not  far  apart, 
the  range  error  due  to  radial  distortion  in  the  optical  system  will  be  magnified  by  a 
correspondingly  large  factor,  which,  in  fact,  becomes  infinite  as  the  difference  between 
their  radial  coordinates  approaches  zero.  On  the  other  hand,  errors  due  to  tangential 
distortion  may  cancel  if  the  effect  of  that  distortion  is  the  same  for  both  images. 

Equations  (22)  and  (23)  in  Section  V  give  an  estimate  of  the  error  in  the  range 
calculated  by  means  of  optical  flow  theoiy.  The  estimate  depends  on  errors  in  the  image- 
plane  coordinates  of  image  points  and  the  FOE.  Normal  optical  system  imperfections, 
listed  in  Section  IV,  are  an  important  but  often  neglected  source  of  such  errors. 
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This  appendix  derives  what,  from  several  points  of  view,  is  probably  the  most 
effective  method  of  calculating  the  translation  and  rotation  vectors,  the  components  of 
which  satisfy  (9).  In  terms  of  all  of  the  available  data,  the  method  leads  to  a  closed-form 
solution  and  is  therefore  free  of  any  convergence  problems  or  unanticipated  numerical 
instabilities. 

It  is  assumed  initially  that  the  optical  flow  data  consists  of  the  values  of  the 
displacements  dx  and  dy  measured  at  10  or  more  image  points.  The  first  step  is  to 
represent  dx  and  dy  as  functions  of  the  image-point  coordinates  x,  y  by  third-degree 
polynomials 


dx  =  Ai  +  Bjx  +  C  iy  +  Dix2  +  Ejxy  +  Fjy2  +  Gjx3  +  Hjx2y  +  Jjxy2  +  Kiy3, 

(A-l) 

dy  =  A2  +  B2X  +  Cjy  +  D2*2  +  E2xy  +  F2y2  +  G2X3  +  H2X2y  +  J2xy2  +  K2y3  . 


If  the  number  of  image-point  measurements  is  greater  than  10,  higher  degree 
approximations,  or  perhaps  a  least  square  error  fit,  can  be  used  to  obtain  the  representation; 
otherwise,  any  type  of  polynomial  interpolation  (e.g.,  Lagrange,  spline)  that  suits  the 
image  contrast  variation  can  be  used. 

Once  the  polynomial  fit  to  the  measured  data  is  accomplished,  the  task  of  calculating 
the  translation  and  rotation  vectors  is  reduced  to  solving  systems  of  at  most  three  linear 
algebraic  equations  at  a  time.  Therefore,  following  the  procedure  described  at  length 
further  on  in  this  appendix,  the  remaining  computation  can  be  done  quickly  and  as 
accurately  as  desired. 

From  the  displacement  definitions  given  by  (7),  with  D  set  equal  to  1,  and  the 
Weierstrass  polynomial  approximation  theorem  (cf.  Ref.  A-l,  p.  65):  if  z  is  a  continuous 


function  of  x  and  y  (it  may  be  assumed  for  physical  reasons  that  z  is  never  zero)  in  the 
closed  clear- aperture  region  of  the  image  plane,  a  uniformly  convergent  approximation  by 
polynomials  is  possible.  If  z  is  constant  over  the  image  plane,  the  displacements  will 
actually  be  polynomials,  but  quadratic  rather  than  cubic.  This  is  a  special  case  which  will 
be  treated  later. 

After  multiplying  through  by  the  denominators  on  both  sides,  with  some  algebraic 
manipulation  and  rearrangement  of  terms  (9)  can  be  written 


C(vy  -  v*y)  dx  +  (vzx  -  vx)  dy]  +  (vytOy  +  vxo)x)  -  (vxo)z  +  vz(Ox)  x 


(A-2) 

-  (vytOz  +  vzC0y)  y  +  (VytOy  +  vzC0z)  X2  -  (VyfOx  +  vx©y)  xy  +  (vz(Oz  +  vx  +  VxCBx)  y2  =  0. 


Note  that  the  collection  of  terms  not  enclosed  in  brackets  is  a  second-degree  polynomial  in 
x  and  y,  the  cubic  terms  that  result  from  clearing  fractions  in  (9)  having  canceled  out 

On  the  other  hand,  after  substitution  from  (A-l)  for  dx  and  dy,  the  collection  inside 
the  brackets  is  a  fourth-degree  polynomial  in  x  and  y.  In  fact,  the  fourth-degree  terms  in 
that  polynomial  together  form  a  homogeneous  polynomial  P4  given  by 

P4  »  G2x4  +  (H2  ~Gi)  x3y  +  (J2  -  Hi)  x2y2  +  (K2  -  Ji)  xy3  -  Kiy4.  (A-3) 

If  the  polynomial  representations  of  dx  and  dy  were  exact  instead  of  approximate, 
the  coefficient  of  each  monomial  term  in  (A-2)  [including  each  of  those  in  (A-3),  of  course] 
would  be  zero.  Thus,  from  (A-3)  it  would  follow  that 

G2  =  Ki .  0,  H2  =  Gi,  J2  =  Hi,  K2  =  Ji  .  (A-4) 

Then  (A-l)  could  be  replaced  by 


dx  *  Ai  +  Bix  +  Ciy  +  Dix2  +  Eixy  +  Fiy2  +  Gix3  +  Hixfy  +  Jixy2  , 

(A-5) 

dy  =  A2  +  B2x  +  C-xy  +  D2X2  +  E2xy  +  F2y2  +  Gix2y  +  Hixy2  +  Jiy3  . 


A-3 


In  some  sense  the  extent  to  which  the  relations  (A-4)  are  satisfied  provides  a 
measure  of  the  accuracy  of  the  data  in  combination  with  that  of  the  polynomial 
approximation.  However,  it  might  be  better  to  consider  an  alternative  polynomial 
approximation. 

Instead  of  using  data  from  a  minimum  of  10  image  points  to  obtain  a  representation 
of  dx  and  dy  in  the  form  (A-l),  an  alternative  would  be  to  use  data  from  a  minimum  of  8 
image  points  to  obtain  a  representation  in  the  form  (A-5).  This  is  equivalent  to  imposing  a 
self-consistency  boundary  condition  on  the  approximation. 

After  determining  the  explicit  polynomial  coefficients  in  (A-l)  or  (A-5),  the  next 
step  is  to  combine  terms  within  the  brackets  in  (A-2)  with  like  terms  inside  and  outside  the 
brackets  and,  as  before,  to  set  the  resulting  coefficient  of  each  separate  monomial  equal  to 
zero.  The  cubic  terms  lead  to  a  system  of  four  linear  homogenous  algebraic  equations  for 
the  components  of  v: 


G2Vx  -  GiVy  -  D2vz  =  0, 
K2vx  -  Kivy  +  Fivz  =  0, 


(A-6) 


H2vx  -  Hivy  +  (Di  -  E2)vz  =  0, 

J2vx  -Jivy  +(Ei-F2)vz  =0. 

If  the  polynomial  representations  for  dx  and  dy  have  the  forms  (A-5),  according  to  (A-4) 
the  system  of  equations  will  reduce  to 

GlVy  +E>2Vz  =  0, 

Jivx  +Fivz  =0, 


(A-7) 

Givx  -  Hivy  +  (Di  -  E2)vz  =  0, 

Hivx  -  Jivy  +(Ei-F2)vz  =0. 


A-4 


In  either  case,  the  result  is  a  system  of  four  linear  homogenous  algebraic  equations 
in  three  unknowns,  of  the  form 


Mnvi  +  M12V2  +  M13V3  =  0, 


M21V1  +  M22V2  +  M23V3  =  0, 
M31V1  +  M32V2  +  M22V3  =  0, 


(A-8) 


M41V1  +  M42V2  +  M43V3  =  0, 


wherein  the  vj  represent  components  of  v  arranged  in  an  arbitrary  order,  but  in  the  Ramp 
order  in  every  equation.  Assuming  that  V3  is  a  nonzero  component  of  v,  if  each  equation 
of  (A-8)  is  divided  by  V3,  the  result  is  a  system  of  four  equations  in  two  unknowns: 


Mnwj  +  M12W2  -  -  Mi 3, 


M21W1  +  M22W2  =  -  M23, 


M31W1  +  M32W2  =  -  M33, 


(A-9) 


M41W1  +  M42W2  =  -  M43, 


where  wj  *  V1/V3  and  W2  =  V2/V3. 


The  linear  system  of  equations  (A-9)  is  overdetermined,  but  its  least  square  error 
solution  can  be  found  by  multiplying  both  sides  by  the  transpose  of  the  coefficient  matrix 
on  the  left-hand  side  and  solving  the  resulting  system 


Awi  +  Bw2  =  C, 


Bwi  +  Dw2  =  E, 


(A-10) 


A-5 


where 

A  =  Mu2  +  M212  +  M312  +  M412,  B  =  M11M12  +  M21M22  +  M31M32+  M4iM42» 

D  »  M122 + M222  +  M322  +  M422,  C  =  -  Mi  1M13  -  M21M23  -  M31M33  -  M41M43, 
E  =  —  M12M13  —  M22M23  -  M32M33  -  M42M43. 


^  As  many  as  three  different  possible  systems  of  the  form  (A-9)  can  be  obtained  from  (A-7) 

or  (A-8),  depending  on  which  component  of  v  is  chosen  for  V3  (assuming  that  more  than 
one  differs  from  zero).  For  greatest  accuracy,  the  choice  should  be  that  for  which  the 
corresponding  coefficient  determinant  AD-B2,  which  is  guaranteed  to  be  nonnegative,  has 
^  the  largest  value. 

To  find  the  components  of  the  rotation  vector  0),  it  is  only  necessary  to  repeat  the 
steps  of  combining  like  monomial  terms  in  (A-2),  this  time  concentrating  on  those  of 
degree  less  than  three,  and  once  more  setting  the  resulting  coefficients  equal  to  zero.  This 
•  will  provide  a  system  of  six  linear  algebraic  equations  in  the  three  unknowns  odx,  coy,  Oh, 

since  the  components  of  v,  having  been  calculated  in  the  previous  step,  will  be  known 
parameters, 

vxto*  +  VyCOy  *  A2vx-Aivy, 


VzODy  +  VyO*  *  -C2VX  +  ClVy-AlVz, 


vz(Ox  +vx©z  =  -B2vx+Bivy  +  A2vz, 

VytOy  +  VzCOz  =  D2V*-DiVy-B2Vz, 

vxG>x  +v20>z  =  F2vx-Fivy  +  CiVz, 


(A-ll) 


VyOx  +  VXG)y  =  -  E2VX  +  ElVy  +  (C2  “  Bl)  Vx  . 

•  To  find  the  least  square  error  solution  to  (A- 11),  again  the  procedure  is  to  multiply 

both  sides  by  the  transpose  of  the  coefficient  matrix.  In  this  case,  the  system  reduces  to 
three  equations  for  the  three  co  components: 


A-6 


flllCOx  +  Ql2<Dy  +  Ql3COi  =  Tl  , 

^21©x  +  ^22®y  +  &23 <br  =  F2  ,  (A-12) 

Q3l£Ox  +  H32£Oy  +  D33G>z  =  1*3  , 

where 

Qn  *  2vx2  +  Vy2  +  vz2,  Q12  =  2vxvy ,  Q13  =  2vxvz , 

Q21  *  2vXVy  ,  fl22  *  VX2  +  2Vy2  +  VZ2,  Q23  =  2VyVZ  , 

&31  *  2vxvz ,  D32  =  2vyvz ,  O33  =  vx2  +  vy2  +  2vz2 , 

and 

n  =  (A2  +  F2)  vx2  -  (Ai  +  F2  +  Fi)  vxvy  +  (Ci  -  B2)  vxvz  +  ElVy2  +  C2VyVZ  +  A2vz2, 
r2  =  -  E2VX2  +  (A2  +  D2  +  Ei)  vxvy  -  Bi  vxvz  -  (Ai  +  Di)  vy2  +  (Ci  -  B2)  vyvz  -  Aivz2, 
F3  =  -  B2vx2  +  (Bi  -  C2)  vxvy  +  (A2  +  D2  +  F2)  vxv2  +  Ci  Vy2  -  (Ai  +  Di  +  Fi)  vyvz 
+  (Ci-B2)v22. 

The  solution  of  the  system  of  equations  (A-12)  is  straightforward  because  its 
coefficient  matrix  is  nonsingular.  Demonstrating  this  is  not  difficult 

The  statement  that  the  coefficient  matrix  of  (A-12)  is  nonsingular  is  equivalent  to  the 
statement  that  it  has  rank  3.  That  this  matrix  has  rank  3  follows  from  the  fact  that  it  must 
have  the  same  rank  as  the  coefficient  matrix  of  (A-l  1),  which,  it  can  be  shown,  has  rank  3. 

To  establish  the  last  fact  it  is  sufficient  to  find  a  nonsingular  3  by  3  submatrix.  For 
this  purpose  just  two  cases  need  to  be  considered:  the  submatrix  consisting  of  the  first 
three  rows  of  the  coefficient  matrix  of  (A-ll)  is  singular  only  if,  first,  v2  vanishes  or, 
second,  vx  and  vy  both  vanish.  Since,  by  hypothesis,  translational  motion  exists,  these 
cases  are  mutually  exclusive. 

In  the  first  case,  if  vx  does  not  also  vanish,  the  submatrix  consisting  of  the  third, 
fifth,  and  sixth  rows  is  nonsingular,  or,  if  it  is  Vy  that  does  not  also  vanish,  the  submatrix 
consisting  of  the  second,  fourth,  and  sixth  rows  is  nonsingular.  In  the  second  case,  the 
submatrix  consisting  of  the  second,  third,  and  fourth  rows  is  nonsingular. 

A-7 


[ 


For  the  special  case  mentioned  earlier  in  which  Z  is  constant  for  all  image  points,  dx 
and  dy  are  both  second-degree  polynomials  in  x  and  y.  Then  in  (A-l)  the  coefficients 
Gi,2,  Hi,2,  Ji,2.  Ki,2  are  all  zero,  as  are  the  coefficients  of  all  monomials  of  higher  degree 
in  the  polynomial  approximations  to  dx  and  dy. 

The  coordinate  system  transformation  vectors  are  then  given  by 


(Ox  =Ei  , 

(Dy  =~Dl  , 

Oh  =-B2  , 


-vx/Z 


=  A]  -Di  , 


(A- 13) 


-  vy/Z  =  A2  -  Ei  , 


-  v2/Z 


It  should  be  noted  that  the  last  three  equations  of  (A-13)  determine  the  direction  but  not  die 
magnitude  of  v,  since  Z,  although  a  constant,  is  still  unknown. 


REFERENCE 


A-l. 


R.  Courant  and  D.  Hilbert,  Methods  of  Mathematical  Physics,  Vol.  I,  English  ed.. 
Interscience,  New  York,  1953. 


A-8 


APPENDIX  B 


RANGING  ACCURACY  IN  A  GENERAL 
GEOMETRICAL  CONFIGURATION 


B-l 


RANGING  ACCURACY  IN  A  GENERAL 
GEOMETRICAL  CONFIGURATION 

This  appendix  extends  the  analysis  of  Section  VI  to  the  most  general  case  in  which 
the  sensor  platform  velocity  is  constant  relative  to  an  object  point  during  the  time  interval 

0  between  two  observations  of  the  point  That  is,  it  is  no  longer  assumed  that  the  passive 

ranging  target  lies  in  the  plane  of  the  velocity  vector  and  the  optical  axis  of  the  sensor. 

Figure  3,  slightly  reinterpreted,  will  do  for  illustrating  the  more  general  geometrical 
configuration  as  well  as  the  more  restrictive  one  treated  in  Section  VI.  The  only  significant 

•  change  is  that  the  object  point  need  not  be  in  the  plane  determined  by  the  velocity  vector  v 
and  the  optical,  or  Z,  axis. 

The  velocity  vector  is  no  longer  assumed  parallel  to  the  ground;  therefore,  the  line 
labeled  h  in  the  figure,  although  assumed  to  be  orthogonal  to  v,  is  not  necessarily  vertical. 

^  In  fact,  the  ground  line  on  which  it  was  originally  assumed  that  the  object  point  was  located 

is  irrelevant  in  the  present  discussion. 

The  line  labeled  h  is  defined  by  the  following  requirements.  It  lies  in  the  plane 

0  determined  by  v  and  the  optical  axis,  it  is  perpendicular  to  v,  and  its  length  is  determined 

by  a  perpendicular  dropped  from  the  object  point 

The  optical  coordinate  system,  which  is  Cartesian  and  right  handed  as  usual, 
includes  the  optical  axis  as  the  Z  axis.  The  X  axis  is  defined  by  requiring  that  it  lie  in  the 

•  plane  determined  by  v  and  the  Z  axis,  and  that  it  make  an  acute  angle  with  v.  The  Y  axis  is 
then  defined  by  the  requirement  that  the  coordinate  system  be  right  handed,  i.e.,  pointing 
out  of  the  page  in  Fig.  3.  The  optical  coordinate  system  can  be  regarded  as  the  result  of  a 
rotation  about  the  Y  axis  of  a  coordinate  system  for  which  the  other  two  axes  consist  of  v 

•  and  the  line  labeled  h. 

For  the  discussion  in  Section  VI,  the  relations 

0v*0i  +  Vi, 

•  6V  -  02  +  V2 
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were  implicitly  assumed  However,  for  the  discussion  in  this  appendix  these  relations  are 
no  longer  valid  because  the  three  angles  in  each  are  in  general  the  vertex  angles  of  a 
pyramid 

Nevertheless,  with  this  interpretation  the  relations 


pi  =  tan  0i, 


p2  =  tan  02 


(B-l) 


are  still  valid.  On  the  other  hand,  it  is  no  longer  necessarily  true  that  pi  -  p2  is 
approximately  equal  to  tan  a. 

Therefore,  investigating  the  behavior  of  the  error  factor  as  the  time  t  between  the 
two  sensor  observations  increases  requires  a  somewhat  different  approach  from  the  one 
adopted  in  Section  VI.  For  this  purpose  the  relation 


R2  cos  02  =  Ri  cos  0i  -  vt  cos  0V 


(B-2) 


is  useful. 

The  quantities  with  subscript  1  in  (B-2),  as  well  as  0V,  are  independent  of  t. 
Therefore,  differentiating  both  sides  of  (B-2)  with  respect  to  t  leads  to  the  equation 


R2  cos  02  -  RjOj  sin  02  =  -  v  cos  0V  .  (B-3) 


On  the  other  hand,  since  the  object  point  is  fixed  it  follows  that 


Rj  =  -  v  cos  y2  . 


(B-4) 


Substituting  from  (B-4)  into  (B-3)  then  provides  the  equation 

02  =  v(cos  0V  -  cos  \jr2  cos  Ojj/Rj  sin  02  ;  (B-5) 

It  follows  from  (B-5)  that 

02^O 

if  (B-6) 

COS  0V  ^  COS  \j/2  COS  02 

since  sin  02  is  positive  and  can  only  vanish  when  the  Z'  axis,  v,  and  the  line  of  sight  to  the 
object  point  in  the  second  observation  position  are  coplanar,  in  which  case  the 
configuration  must  be  the  one  treated  in  Section  VL 

It  follows  from  (B-l)  that  the  error  factor  decreases  as  long  as  the  inequality 
condition  in  (B-6)  is  satisfied,  and  it  reaches  a  minimum  when  the  equality  condition  is 
satisfied.  That  is,  the  ranging  accuracy  improves  as  the  time  interval  between  sensor 
observations  increases  from  zero,  but  only  for  a  while,  and  there  is  an  optimum  time 
interval  for  which  the  error  sensitivity  is  a  minimum.  The  major  difference  between  this 
conclusion  and  a  similar  one  reached  in  Section  VI  is  that  for  an  object  point  sufficiently  far 
off  track  it  is  conceivable  that  the  image  point  may  still  be  within  the  sensor  field  of  view 
when  the  optimum  interval  between  observations  actually  occurs. 


